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ABSTRACT 

This publication offers 10 major policy 
recommendations for _ improving. the evaluation of secondary vocational 
education programs for special populations. and ultimately the 
programs themselves. In the 10 sect ibiis following ah introduction, 
each of the policy areas is introduced by a brief overview. A policy 
recommendation is then made_ along with a brief rationale and overview 
of potential benefits. The 10 recbmmehdat ions are concerned with 
stakeholder involvement , context analysis, problem delineation, 
multiple goals, evaluation focus, process and product evaluations, 
mult i pie methods of evaluation , evaluation utilization , continuous 
evaluation^ and managing the evaluation. An appendix lists 
characteristics of effective secondary vocational education jprograms 
for special populations. (YLB) 
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FOREWORD 



_ Federal, state, and local education agencies have indicated the importance of 
evaluating vocanonal education programs for special populations. Corprehensive evaluation 

'^ ^'^'^^^^ effectiveness of efforts to proS quality 

vocational education to special populations. Understanding general characteristics of 
ef ective vo^cational education prog^^^^^ , framework for devSoping gSeLes that 

will assist the education agencies in program improvement and planning efforts 

This report, g^glines for Evaliiafino SP cottdaf^^A^^^ional Ednnnfinn P .^e..^. f^. 

variables contributing to effective vocational education programs for special populat'onl 

.f.frWrS^'°''i '^^''^u '° ^^P'^" appreciation to the consultants and to the 

M^r^K r ? ° '^^^'^'^ °" Consultants for the study were Dr Edgar I Farmer 

rJ^^. P I University; Dr. Seymour Lesh, National Child Labor lommUtee Dr ' 

SmLois Department of Education; and Dr. L. Allen Univ^Iity 

fnr _'^'''^ PpJ«ct was conducted in the Evaluation and Policy Division, the National Center 
for Research m Vocational Education, under Dr. N. L. McCaslin Associate D^ecTor^^^^^^ 

Mahlman Paal V. Unger, and Michael Smith, Graduate Research A«o°1aSf Finai edito,-l 



to improve secondary vocational programs for spiciil populationT ^ "'S" 

DeparTmlrotEdltllr'' ^<'"-«-. S. 



Ray D. Ryan 
Executive Dirsctdr 
The National Center for Research 
in Vocational Education 



EXECUTIVE SUMMARY 



- Although vocational educators have addressed the need For special popuiatibris to have 
full access to quality vocational programs, few resources exist concerning the overall 

^"^"* M ^^.L^"^^ programs for special populations This reoort 

presents overal guidelines for evaluating secondary vocational education programs fSr 
special popu ations. The following recommendations for improving the evaSn process 
were Identified based on a review of evaluation literature, input from expe S 

foT S p!opVlStio:^^^^^^"'^^^" °' --"^-^ educS pTograms 



EVALUATION GUIDELINES 

Stakeholder Involvement 

- The role of ^stakehoid^^^^^^ program evaluations should be expanded. The evaluation 
should involve individuals in the program to be evaluated and those affected bv the 
TytSlderr'"'""" '^""'"'^^^^ '"^'^ encourage'^^tw-thrCg^ 

Context Analysis 

- Because the_ combination of contextual factors surrounding the program influences 

functioning the context in which the program exists should be exam ned in 
sufficient detail to ensure that the evaluation is responsive. 

Problem Delineation 

-- Problems to be considered in program evaluation efforts should be identified and 
developed by people who are involved in and affected by the program 

Maltlple Goals 

-- Evaluatjon should consider all goals of the program not just those goals that are 
required to be evaluated by federal mandate? 

Evaluation Focus 
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Process and Product Evaluations 

Sr^.T/o""''""' °^ vocational education programs for special populations should 
be related to program outcomes. 

Multiple Methods 



Mc^T^^T''^^ ^' '^'''''^''' '^^"^ruent with the evaluation 
objectives. A blending of quantitative and qualitative methodologies may be 
appropriate. The evaluation should recognize that different methods are 
appropriate for different situations. 



Evaluation Utill2atJon 

- Ppram evaluations should be conducted and reported to ensure that the diverse 
information needs of specified audiences are met. aiverse 

Continuous Evaluation 

Managing the Evaluation 

-- The responsibility for evaluation and improvement of vocational education programs 
for special populations should be placed under local management. 
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INTRODUCTION 



Vocational education opportunities in secondary schools are provided to special 
populations for a variety of reasons. First, these individuals have the same neeas as 
anyone else to develop skills necessary to enter the Jabor force and to become contributing 
members of society. Second, it is far more cost-effective to educate these students than 
to provide public support on an ongoing b:asis. Third, equal educational rights Include 
access to vocational education programs. Fourth, federal legislation mandates the 
continuing emphasis on providing quality vocational education for special populations 
Federal interest to serve special populations is strong. But, answers to the question "How 
well ^nd 10 what extent are special populations being served?" are hampered by a lack of 
credible information. 

'^^J^^ of vocational education program evaluation information for special 
^^f^^^f'^^^ program improvement. If meaningful secondary vocational 

education programs are to be provided for special populations, we need to know what the 
characteristics of effective programs are and to develop evaluation guidelines that will 
assist educators to improve program efforts. 

To help meet these objectives, the National Center for Research in Vocational 
Education conducted a study to determine the characteristics of effective secondary 
vocational education programs for special populations. Within an organizing framework 
selectedTor the study, three major approaches were used to collect a comprehensive set of 
data._Jhe approaches were a review of the literature, on-site visits to local schools, and 
I'^^'^'^y^l^'^^^oj^^iors of secondary vocational education programs for special 
populations. The organizing framework and the research methodology are detailed in the 

V gh9.^^ten.tics of E ff ecti^e^fm,4^ v Vncafinn.l Education Pro.r.m^. 
SEeemLPoESlMmm. That report is thematically organized around the following areas: 

0 Efefflents of igugfil(y 
- General Context 

— School setting 

— Classroom setting, including facilities and equipment 
Personnel characteristics 

Student characteristics 
Financial 
- Educational Experience 
Preassessment 
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Individualized education programs 
-- Curriculum 
-- Instruction 

Support services 
0 Asse ssing Oualttv 

- Program Evaluation 

- Student Evaluation 

Each area in the cempanion report addresses key characteristics essential to effective 
secondary vocational education programs for special populations-characteristics that are 
mdicative of quality programs. The characteristics of effective secondary vocational 
education programs for special populations are provided in appendix A. Of particular 
relevance to Jhe second phase of the study^ were the findings related to program 
evaluation. Effectiveness criteria suggested in the characteristics study are as follows: 

0 A large variety of people who are involved in the program are also involved in the 
evaluation of the program. 

0 A variety of input, process, and outcome variables are considered during the 
evaluation. 

Evaluation reports have multiple uses including program planning, improvement 
accountability, and legal compliance. 

0 Employers and parents are involved in the evaluation of the program. 

_ These four effectiveness criteria led to the identification of major areas within 
which guidelines for conducting program evaluations would be developed. The areas were 
stakeholder mvolvement, multiple goals, evaluation focus, and evaluation utilization 
Although these areas were covered specifjcally under program evaluation, the char- 
acteristics^studj' contained valuable information for helping direct evaluation efforts yet 
further. Six additional areas that emerged from an in-depth analysis of the char- 
acteristics study and a review of evaluation literature were context analysis, problem 
delmeation process and product evaluations, multiple methods, continuous evaluation and 
managing the evaluation. ' 

^ The guide is intended to serve as a resource for evaluating secondary vdcafiohal 
eaucation prograins for special populations. The purpose is not to write another textbook- 
with de.initions of concepts, discussions of underlying theories, critiques of evaluation 
models, and references to the literature-or another "how-to" book with lengthy step-bv- 
step procedures designed to take the totally uninitiated reader through the evaluation 
process. Rather, this publication presents guideline recommendations inte^iJed for use and 
adaptation by individuals involved in policy making, planning, and evaluation of vocational 
education programs for special populations. For example, as administrators in local 
education agencies continue in their quest for educational excellence, this guide will 
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r^^^a^S^^^ ^^^'^^'^^' P^^i and conducting evaluations of vocational education 
programs for special populations. "-uuwanuu 

The uitimate beripficiaries of this guide ire the individuals who, as defined by the 
Department of Education, fit into at least one of the foilowihg categories: 

Dis^avantafi^ -individuals (other than handicapped individuals) who have economic 
or academic disadvantages and who require special services and assistance in order 
to^enable Jhem to succeed in vocational education programs. This term includes 
individua s who are members of economically disadvantaged families; migrants 
individuals whahave limited English proficiency and individuals who are dropouts 
from, or potential dropouts from, secondary schools. 

^^■'TS'^f^ '^'T'^^ who are mentally retarded, hard of hearing; deaf, speech 
impaired, deaj-bhnd, or multihandicapped, or persons with specific learning 
disabilities^whO by reason thereof require special education and related services, 
and who,^ because of their handicapping condition, cannot succeed in the regular 
vocational education program without special education assistance. 

Limi tgd Enslish pfoPtHpm --indi who were not born in the United States or 

wfi^r! Tirf ' ^.^la^gu^ge other jthan English- who came from environments 

S "i^"" ^"^^'''^ dominant; or who are American Indian and 

??crf^. rV "-"•r-""'^ environments where a language other than 

English has had a significant impact on their level of English language profi- 
ciency; and who by reason thereof; have sufficient difficulty speaking, reading 
run tv^nT. " English language to deny these individuals the oppor- 

tunity to learn successfully m classrooms where the language of instruction is 
English or to participate ful'y in oar society. 

S^^.^2reni--an individual who is unmarried or legally separated from a spouse- 
custody.' °' "^^''^ P^--^"' ^"^'^ ^"«'°dy or joint 

In addition to the four population groups named above, there is recognized also a need 
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S^pi-behaviors resulting from the assumption that One sex is superior to the 



Sex ?tergqtYping -attributing behaviors; abilities, interests. Values, and roles t5 
a person or group of persons on the basis of their sex. 

:^This publication, Guidelines^ fei^^liiafinp Secondar" Vriratm«aJ^»^t;«„ a 

e^StSt-'^^^'^^^^^^ 

evalua ion of secondary vocational education programs for special populations and 

fn i;;' ^h' ''-f 'T''^"'"'''"^^- """^ °f the guidelines ar^^u.^.tly ?ehi'g 
foDowed ra lonwide. In fact, staff efforts to obtain direct in^^at frOm tfe f eld wir. not 
as successful as had been hoped. Program evaluations as curremly condSctId are not 
agS Ire ch^.'^ program improvement, in part, because fede^arsfa^'rid" caT 
agencies are charg^u .vith so many program accountability responsibilities. 
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fir.n.V^^''^'°''^^"^^'^^ ^^'^'^ °" ^ ""^^^^^ °f eviiuation literature, recommenda- 

J'-o'T ewe^^^^^^^ who have a st^5iii and continued interest in 

^SS^r^^^"^^ '^■'^^''f P^P"J^t^O"s, and on findiHis stemming from the research 

to ca^y oat this study. The companion document to this report can serve a 
P^'-^c^ff'y u^efui purpose m identifying content considerations for the program evalua- 
t'on- This guide, on the other hand, focuses on the processes involved in conducting the 
evaluation melf. in the following sections, each of the iO policy areas is introduc£i l^y 
po^en^arbeHefS. recommendation is then made along with a brief rationale and 
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EVAtUATION GUIDELINES 
1. STAKEHOLDER INVOLVEMENt 



^ Top often, evaluation is viewed as a necessary evii mandated by federal legisiation 
and conduced by an expert consQltant or external team. And, the evaluation is expected to 
be accomplisjied wjth minimum disruption to the ongoing activities of the program. However 
to produce the desired result of program improvement, evaluation efforts must involve the ' 
many parties that have a stake in vocational education programs for special populations. 

^ ^ Stakeholders include individuals who will make decisions based upon evaluation 
findings, persons involved in program planning and implementation; persons sponsoring the 
evaluation, persons who may be affected by the evaluation, program advocates, and the 
target group. In other words; stakeholders are students, teachers, administrators 
counselors, parents, and employers, among others. Of particular importance to vocational 
education programs for special populations is involvement on the part of parents 
employers, and students. Because parents have so much at stake and sometimes hold negative 
attitudes toward the program, it is essential that they be given the opportuniTy to 
contribute to program improvement through their inputs to the evaluation process 
Employers, as the source of employment, hold one of the keys to graduates' success 
Special population students, of course, have the greatest stake in the results of the 
evaluation and could offer valuable input. 

Stakeholders' viewpoints are as diverse as their expectations of the program. For 

^^fn^''^ ''^^ expect trained workers, and 

students expect adequate preparation for future life roles. 

If vocational education programs targeted for special populations are to farther the 
,J'°'"'"'*'"l"* ^° ^''"^^ educational opportunity, consistent input from program 
tm"'' major priority in the evaluation process. The inadequate con- 
sideration of the needs and opimons of the groups intended to benefit from programs 
affects not only^the kinds of questions asked about programs, but also results inS- 
moil effe?t™e '° '"^'^^ ^^e programs 

e..i.«M'"'°'*^^''K"''.°'''^'"^"' throughout the evaluation process is crucial. Initially 
stakeholders can be instrumental in identifying goals and major problem areas. Th^'y will 
be valuable sources of assessment data during the evaluation itself. And, stakeholders ^an 
help interpret evaluation findings, can make suggestions for modifying pVograni ° and can 
take an active role in bringing about the desired changes. ograms, ana can 

.i;;.. i J''^ '''^■'^ of stnkehnWpfHfl^rogram evainatinn. .hn u ld b&man^>d. The evain^fi nn 
stakeSer/ ^''^ '^^'""^ ^H^^nndnptrd in ways^l^.r enr ^^^^^^^jj^ 
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STAKEHetOER INVOVEMENT 



^ Stakeholder involvement in the total evaluation process wiii faciiitate program 
improvement efforts. Program imprbvemeht generally Implies change, and change of any 
type IS typically met with. resistance. As a result of active invoivement, stakeholders 
will develop support for the program and commitment to making the change. 

'^f^^^^'^ involvement ensures that the right problems for a particular setting are 
addressed. External eValuators may fail to focus on the real problems and be less 
responsive o the needs and interests of specific audiences. Stakeholder involvement 
furthsr ensures that the data collection methods and the information generated would be 
viewed as valid. 

The potential benefits of this recommendation include the following: 
o Increased use of evaluation results 

o Attention to problems that are of particular importance to the setting 
o Furtherance of equal educational opportunity 

o Commitment to program improvement and the changes needed to bring it about 
o Sense of program ownership 

o Greater collabdratibh among program constituents 

Stakeholders^ who are involved in the evaluation process are more likely to believe and 

ielSl^'-^r ■? l-rr 'r^'"'-^'"" ' ^'^^bilities teacher who h£ 

Hke^t tf.Sn ^ ■ maintaining classroom discipline as a problem is more 

likely to accept and implement suggestions for dealing with short attention spans, negative 
self images, and demands for attention. In another example, a survey of state vocat'onal 
education special population coordinators revealed that there was a need to involv^more 
employers m the evaluation of programs. Employers who are not hiring gradua e ' oT° pecial 
population programs can develop a deeper understanding of the program and greater inheres 
in the graduates when they are involved in program evaluations 
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2. CONTEXT ANALYSIS 



Most evaluations of secondary vocational education proi^ims "for special populations do 
"°^8've adequate consideration to the educational and community settings. The program 

the environment within which the program operates. Vocational education 
programs for special populations are conducted in area vocational schools, magnet schools 
comprehensive high schools, and alternative schools; they are conducted in remote rural ' 
areas, congested urban districts, and the suburbs; they are conducted in communities with 
high unemployment rates and in communities characterized by high socioeconomic status" they 
are conducted in newly appointed facilities or in buildings that long ago outlived their ' 
usefulness. 

^ Just as these physical environments vary, so do social environments vary Student 
demographies, school-community linkages, and the nature of staff are illustrative aspects 
ot the social context. For example. We must recognize that students participate in 
vocational education programs to various degrees. Participation ranges from extensive 
involvement in vocational education to Incidental enrollment In a single course This 
diversity of vocational education experience I5 an important contextual factor to consider 
when we make decisions about the delivery of vocational education programs to special 
populations. 

»nH that d incorporate a context analysis component sometimes go overboard 

and expend all resources available On "getting a feel for the program." This results in a 
ta.lure to Identify needed program Improvements and obtain measures of program quality An 
understanding of the contextual factors is Important to determine what course of ac^^n may 
be taken or what factors affect Certain program outcomes. 

r - BgC3tige the combination of coBtemj^ tors surrnnnding the nrogram^.tfU.^ c its 

f^n^,. the rontext in which the pSei^uK .„n„,d JLJiz L 

dgt^tH^nsure that thP, evaluatinn k resmwswft 

^v.l„^-^ ^°"J>^^\'".'^'''^^^^^^^ ignored in effective program 

H, ; . C.°"text analysis provides for developing a better understanding of major 
factors that influence the program. Such information is required to ensure that the 
interpretation of evaluation findings is realistic and appropriate for the situation A 
'^^'J^^''^°j\f^^^ <'°^^'^is wimn which the program Is offered will help others 
judge Its potential for success in other, similar contexts. Such information will 
encourage broader application of successful vocational education practices. 

It is impoj-tant to note that context analysis is closely tied to stakeholder 
involvement Stakeholders are in the best position to identify program constraints 
deveTopJd' """" ^^'""^ stakeholder involvement In the evaluation can be 
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GONTEXT ANALYSIS 



The recommendation to examine the program's context has the following notential 
benefits: 



0 liicr ased responsiveness 

0 Enhanced communications among administrators, teachers, evaluators, 
students, and special interest groups 

0 Higher quality information for program planning 

0 Greater stakeholder involvement 

0 Improved adaptability of program components in similar settings 

0 Broader use of successful practices 



A^thciugh context analysis is important to the evolution of all programs, it is of 
particular importance to students with special needs. For example, the lack of access to 
the facility itself or to classrooms, within a facility still represents a barrier to the 
physically handicapped student. Many older school buildings have numerous staircases and 
no elevators. In this instance, the physical barrier is insurmountable for some 
handicapped students. In other instances, the barriers may be more subtle. Work stations 
that are too high for a student confined to a wheelchair represents another type of 
ijarrier. Evaluations that take into account these types of factors can identify thtz^ 
barriers and pfopose viable sdlutiohs, in other words; be_ more responsive. Trying to be 
more responsive will both contribute to and benefit from enhanced communications and 
greater stakeholder involvement. The contextual analysis^ that focuses upon the needs of a 
special population is bound to yield higher quality information, improved adaptability of 
program components, and broader use of successful practices. 
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3. PROBLEM DELINEATION 



One^of the major reasons for the lack of program iiiiprbvemerit activity at the local 
level IS the fact that local decision makers pay little attention to evaluation fiiidinKs- 
particularly those conducted to meet federally and state level^inspired requirements 
Factors important to program decision making at the local ievel are not generallv 
considered in most mandated evaluation efforts. 

nf f ^1^;."^°" not be realistic in light 

of the needs m a specific community. Because every school district must look at its own 
information needs, the problem identification process is tied closely to context analysis 
and stakeholder involvement. Program stakeholders must play a role in identifying the 
problems to be addressed by the evaluation, since they are the ones who will be making the 

""f°^?'"^^.V^f'='^'°"S- Th^'^ involvement will help overcome the lack of reliance on 
program evaluation findings. i>^iiaiiv,c uh 

. Identifying problems to be addressed becomes an integral part of the evaluation 
process Itself. As the various audiences interact and present their differing views the 
more important problems begin to emerge. Problem identification can be facilitated by 

ffH ''"""'^r'!'^''"''"' '"'^^^^ may hold similar Opinions on some issues and widely 
S Y^^^s °" As the groups discuss and debate the 

issues, they ;earn JO compromise and reach consensus on the important problems. What is 
to S'nSnfn'f'' •^^.r)'"'-' '!: 'hat even without consensus, the evaluation can be responsive 

! T ''^ % ^"f e"ces If they are involved in the process of problem 
identification and clarification. 

Problem? tP yansidefgd-in program evalnntin n efforts -itiriMld be iden ifiP.H P nH 
devglopgd by pgp plg wjK^e-mvolved in .nH effected hv fh^^ ^^ -Ll^nS 

Problem delineation by individuals involved In and affected bv the program is of 
particular importance m ensuring the timeliness of the problems to be addreSed Trends 
in^sach areas as demography, the labor market, societal expectations, and technology a"e 

"SnHn t°me."' '"""'^"'^ '""^ P-^- 't 

_ individuals involved in the problem delineation phase will develop a better under- 
standing of the program and what it is trying to achieve. They will alL gain ins^ghi nto 

^ke'oll^STbro dl''" involvement with different audienS w U giv a.^ 

staKenoiders a broader perspective of the program. 

lncIuc^S^l!;^Sf '° implementation of this recommendation 
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PROBLEM DELINEATION 



d A problem framework for guiding the evaiuation effort 

d Easier identification of problem sources and the barriers to overcoming them 

d Greater objectivity In problem identification 

d Increased utility of evaluation findings 

d Cdmmdn understanding of program 

^ _ Whereas the evaluation process may be generically applied to many different 
educational orograms. the pro special population groups will be different 

beca_use of differences m the characteristics of th A program for the severely 

handicapped, /or example, musldeal with the handicaps of the students in terms of 
facihties.jquipment, teaching materials, schedules, and so forth. The delineation of 
these problems will make it easier to identify their causes and the difficulties In dealing 
with them; for^example. on^ are identified as a problem area for ihe 

Ti"^u program, it will be easier to discover the sources of the problems 

and the barriers to solutions. If the problems are identified by a full range of stake- 

^?^jr'"?^'?!f'''"i^^^ home, and cOmmunity-they are likely to be more 

objectively stated and better balanced. Problems delineated in this way will be utilized 
more fully and the entire community will develop a deeper understanding of the program's 
goals and of the special populations it serves. program s 
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4. MULTIPLE GOALS 



_ Secondary vocationa education for special populations has as one of its main goals to 
impart^entry-level job skills. However, vocational education is concerned also wTth 
pmvidmg experiences that prepare youth for contijvued educational opportunities as well 
as for family, social, civic, and personal responsibilities; 

^ /^'^'''^^^'^^^c^ion legislation has provided the impetus for using 
standardized outcome measures to assess vocational education quality. In 1976 Congress 
introduced standardization by requiring that all vocational education progra^nrb^ evSed 
according to two major criteria: (1) the extent to which program participant find Sbs 
within their area of training and (2) the extent to which employers a^ sKsfied with 
^l^^!^"!^^ f'T'^'-^"" employment. These criteria still drive the development 
of^many vocational education programs in spite of the fact that the current legislation 
takes a_broader view. The Carl D. Perkins Vocational Education Act of 1984 c^ S for 
evaluative measures such as "(i) the occupations to be trained for, which will ref i a 
reahstic asyssment of theJabor market needs of the state; (ii) the levels of kill"to 
be achieved ij, particular 0^^^^^^^^ ^^^^^^ ^^.^^ ^ ^ employers' 

r>4&\U ^ - ' '""i''^^ to be used in peiformance outcomS, wh ch will 

th^ hL^ h'^^"8 needj of en^pioyers." The underlying philosophy of the legislation is 
that better information wiH yield better decisions and that the quality of vocationaT 
education programs ultimately will be improved. vocational 

tn^t. ^^^^''V"^ ^^''l ^'^^''^^^^^^ ^^""^ program evaluations have often been conducted as a 
matter of compliance for federal reporting with little attention to other aspects oTd^o 
'h^,^^'"^Aanc«' 'he program improvement needs for locS^oca° onal 
education programs have not been well served by these evaluations. 

Hr^oJ^ '''°'^?^ evaluations of vocational education 

programs must go beyond assessments and against the traditional criterion of pSUm'on 
for job placement. In searching for other indicators of program qua^rwe musrcoiSSur 
individual development, societal needs, and future change. consider 

^ When dealing with special populations, We should be particularly well aWare of fhP 
tact that vocational education programs must address the unique aSLrncesTmong 
individuals and among groups in order to educate them for future socie«^7oleT"ncludin. 
i^SasJ^'Shood ^^ff^ihe different approaches for speci^l^SlatS ' 
increase the likehhood that the program will be responsive to these differences. 

^ Program evaluation must, therefore, be oased upon a recognition of the fact that 
programs have multiple goals-goals that are often conflicting. Th s recognitio^^ 
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MULTIPLE GOALS 



.. .. _ J^®f.°8"'.Z'"8 .that secondary vocational education prbgrairs for sijecia! populations also 
have multiple goals will do much to help present a clearer and more accurate picture of 
vocational education programs for special populations and how they can be improved; It is 
imperative to understand that there are two important uses of data from evaluation efforts- 
':®.P°'"'^'"8 purposes and program improvement. Ofterii data collected for one purpose may 
enhance data for the other and enrich the interpretation of both. 

. The recommendatioji to consider the program's multiple goals is applicable to all 
vocational education programs; it is especially important for special population programs 
Numerous philosophies impinge upon the directions taken in vocational education programs 
for special groups. As a result, both the number of alternative approaches implemented and 
the number of program goals are typically increased. 

The potential benefits stemming from the recommendation include the following: 
o High-quality information for local program improvement efforts 
o Data that are of greater relevance to the local school setting 
o A stronger position for advocacy of vocational education 
b Recognition of important program quality factors 

• Vr , information from an evaluation that stems from multiple goals locally derived 
IS liRely to be of higher quality than that of an externally inspired evaluation It is 
likely to be more relevant locally, better understood, and more useful in program 
improvement. The parents of special population students will be less resistant to 
enrollment in vocational education programs when they recognize the multiple goals of the 
program revealed m its evaluation. Further, these parents and other stakeholders are more 
Iikejy to be advocates of vocational education for special populations when they see 
evaluation results which show that their children are being well served by the program 
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5. EVALUATION FOCUS 



Throughout Ae nation, hundreds^ of instructional strategies are being tried in 
classrooms, schools, and districts-computer-assisted instruction, self-programmed 
^^^;^'^^'^fy^^,^^''^f^^on,j^ teaching, to name a few, In addition to 
edSatSi pr«'''''°"' implemented in secondary vocational 

T'o^'^^entify tho^e developments most likely to further vocational education goals is 
one major purpose that evaluation can serve. Problem delineation, as an early step n 
designing an evaluation, may result in a long list of problem areas that must be Scused on 
to ensure manageabihty. A number of key factors are commonly recognized S Beinfof 
primary importance in determining the effectiveness and efficiency orseSndSy vocat°onaI 
?oSng a'rSr"' Populations. Thus, the evaluation may considerTsr 

o Student referral 

o Student placement 

o Student progress 

o Student outcomes 

o School and classroom climate 

o Staff behavior and satisfaction 

o Organization of programs/services 

o Resources 

o Instructional practices 

In more general terms, the evaluation should focus on four general aspects of the 

l^^^n^^"'"^^^^^ ^^"'^"^ characteristics, Characte^istLf o? p^£^ 

implementation, and program butcbmes. ^6*<i"i 

fiu^iipiMs s s ^mmm-'^s-^' 

^^"^^^m Kuf di— - --d in the 

imnorl^n?"f!f ^''^''"^ ""^^^ ^^^'"^^e are situation-specific, it is 

important to maintain the involvement of stakeholders in focusing th^ evaluation. This 
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EVAtUATIOM FOCUS 



will en?ure that appropriate areas will be investigated, and that the Reneral thru<!t nf th^ 
evaluation will serve the needs of program cdnstftuents ^ " 

^ In addition, the stakeholders will be helpful in identifying sources of evaliiafiori 
data, recommending schedules for collecting data, and describing thT£cisiL-m^^^^^^ 
process to be served. In this way, objective, for 'the evaluatiolf can be de^pSl T^ese 
objectives will guide the evaluation process and facilitate coordination of its various 

The potential benefits of this recommendation include the following: 
o Increased probability of u.icovering program effects 
b Information that is credible 

o Depth with sufficient breadth of information about the program 
o Ability to compare programs on common factors 
o Obtaining information when it is needed 

peers. An evaluation that failed to uncover this aipect would bl l^creSble % ^ v of 

be deep and broad enough to suggest ways to improve them For the benefit of th^ ^S'.i 
populations student. An evaluation focus that is clear w^ll mi J« ? • ft ^^^'^^ 
programs more feasible when similar S^ceJns are Sdr^^" d" """^ 
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6. PROCESS AND PRODUCT EVALUATIONS 



Program evaluations in vocational education have emphasized summative and brbduct 
evaluations with little attention to the processes of edueat'oiial practice. Summative or 
product^evaluations are conducted for the purpose of making basic decisions about whether 
or not the program IS effective and to answer the question of whether or not the program 
should be continued, expanded, Or terminated. 

^ Although product evaluations are useful, they provide little help in understanding the 
internal dynamics of program operations. Process evaluations, on the other hand, require a 
detailed description of theje operations. A process focus in an evaluation places emphasis 
on looking at how an outcome is produced rather than looking at the outcome itself From 
this perspective, we recognize that a process evaluation follows an inductive approach. 

A process focos requires that we pay close attention to both quantitative and qual- 
itative changes m programs throughout their devalopment and implementation. Process 
evaluations are particularly important for revealing areas in which programs can be 
improved. In fact, the major reason for conducting process or formative evaluations is 
program improvement. uanuus is 

. ^ at Planned program activities and anticipated program outcomes 

a^formatr^ eva^aation takes into account informal patterns and unanticipated consequences 
throughout the program development and implementation cycle. consequences 

_ Process evajuations are designed and implemented to monitor program progress and to 

tion programs, especially those for special populations, often apply creative or emerging 
instructional techniques, student outcomes cannot always be accurately predicted. F^r fhis 
reason, process evaluation, which provides periodic feedback to stakeholders about program 
practices, IS more useful, Process evaluations suggest areas in which programs may Sy 
be meeting their goals as well as those in which improvement or a procedural chang' is 

thrn^^i^lw^^^^^ ^^'^^ Assessments of program success are made 

S^n/^ ^ supplementary information about the results of previous 

changes. The periodic information to students, teachers, and others is often a sourS^of 
hPlnrH-^"?'"' continuing flow of information about the program to admfnStmors 

he^s direct or redirect the allocation of resources to provide betted support to Te 
program. 
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PROCESS AND PRODUGT EVALUATIONS 



Potentiai benefits stemming from this recommendation iriclude the following: 

o Understanding of program dynamics 

o Adjustments to program on ongoing basis 

o Improved programs and services for special populations 

An understanding of program dynamics by all parties involved in a vocational education 

program for special populations is essential tO program improvement. The process evalua- 
tion that prevides data about the ongoing program operation facilitates course adjustments 
thatjmprove overall services. For example, the need to provide additional support 
servjces (e.g., tutors^ notetakers) may be identified when students first encounter diffi- 
culties m mainstreamed classes. Unlike summative evaluations that require a longer 
program_ improvement cycle, process evaluations appear to be far more responsive less 
threatening, and easier to use. This guideline, along with the others recommended, involve 
the stakeholders m critical aspects of the program. 
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7. MULTjPLiE MEtHODS 



H^f.fJr^ 'f^'^ '1! '^^ ^'°^"^^° be addressed by the evaluation should be the kev 
deterininant for the data eodection methods to be used. Evaluations are far too fre- 
quently earned out by first determining the methods to be used and then determining what 
can be assessed. In other words, the evaluation design dictates the questions th« can b^ 
answered by jhe evaluation. More appropriately, the evaluation design should sTem from the 

ti^»f^^''^'^^^S^ and quantitative evaluation methods are useful in assessing voca^ 
tional propams. Quahtative forms of inquiry hold promise for providing a coinpiete and 
On P'-^g'-^'"^ for special populatTons 

a^rgene^liru ed foT%°" T -1 Pyc)cess evaluation than quantit^atfve methods and 

are generally^used to understand programs in their entirety. They look at various oarts of 
the program ,n relation to each other and do not impose any preexisting LtSSdns 
Qualitative data are collected in ways that do not intrude in the ongoing activuS "f 'the 
SSis IJJ.^^ -"^^^ - dSie'dSSn; f 
progr^ '^flLtiven^^^^ ^^^^ -P-t On 

Quantitative methods, too, have a place in the evaluation of vocational education 

t^alSl^lef ".'f '"^r^ These m thods a^eTe 

traditional ones used to evaluate secondary vocational education programs resulting in 
numerical data that can be summarized or otherwise manipulated Sweve any o^e aspect 
It Ln'.^'I'n'-^'" -^^^^^^^^^^^^ quantitative methods ai^'^used The 

mSsured fs reduc^rnr ^'^H^^ ^"''^ '° convergent, because whatever 1 beilg 

^!!nc t« P^ced in a category, and assigned a number. What that number 

m^ns--how It can be interpreted-may be shallow without accompanying quaSmTlve data 
A combination of methodologies using both quantitative and quaUtative sfraSs will 
usually provide a fuller view of all program aspects. strategies will 

'"J^^'^'i" ^ ^^"ety of data collection methods, an evaluation can be 

enhanced by obtaining information from multiple sources. PrograS ^eco d^nd other 
documenta ion, interviews with key people, observations, and qiiesHonnaSs a^e 
[fie'Snf^h'' rT sourcer^ne carcapftali.e on 

anro^T^f.;proag!^r^ ^'^^'^ ^'^'-'^^^ the weaknesses ^inhe'Snrin 

Umd£!^'tS.!!!^^ selected 4 ^^nPrn.nt .U. ...u,^.^ 

t7.L f P'5"^;»y"^^^^^«^t'tative and Qualitati v e ^Beffetf}n^np .•p^ moY ho rtrrrnnrhtT 

A »?^tM°^,-u"''5'^ methods contributes to the methodological rigor of the evaluation 
and the likelihood that key aspects of the program will be addressed The seleSfn of 
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MULTIPLE METHODS 



exarilple, data ?:ready available; Resources available for conducting the evaluation, and the 
feasibility of employing certain procedures may suggest particuiar strategies. In addi- 
tion, the ease of analysis, availability of analytic tools, and the reporting requirements 
and tmieframe may limit the data collection methods and information sources that are viable 
components in the evaluation design. 

Potential benefits of using multiple methods inciude the foilowing: 

0 Appropriateness of information for type Of evaluation question to be answered 

0 Credibility of evaluation findings 

b Increased acceptance of findings by program conrtituehts 
6 Greater methodologicai rigor 

Persons involved in programs for special populatiOhs--whether they are students 
parents, employers, or educational professionals— will Judge the credibility of an 
evaluation on the basis of the appropriateness of the information provided. For example 
parents of special needs students who are experiencing great difficulties in a vocationa' ' 
education program will nojt find credible evaluation results that laud the program as 
excellent without recognizing obvious shortcomings. To the extent that the appropriateness 
of inforn-jition is a function of methods used, the acceptance of findings will be dependent 
on methods and the rigor with which they are applied. Because much of the data will be 
collected from those involved in the programs, they will be generally aware of the validity 
01 the iindmgs. 
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B. EVALUATION UTILiZATlON 



_ A frequently voiced Criticism of evaluation is that evaluation findings are seldom 
used. The use of evaluation results by various audiences depends upon several factors 
These include the evaluator's role in the dissemination of evaluation results the 
resistance to change, the availability of evaluation information, the timeline'ss of the 
evaluation results, and the nature of the evaluation findings themselves. 

Evilbators need^to ensure that all of the appropriate audiences receive the results of 
evaluation efforts. More impOrtaht, audiences should be differentiated because they have 
varying kinds of interests in the evaluation. Reports, whether they be written oral 
formal or informal, should cOmmUhicate the evaluation results in a manner that can' best be 
understood by their intended audiences. ° 

Evaluates Often perceive their role in the evaluation process as finished when they 
have produced a single report and turned it over to the sponsor or administrator Vet it 
IS the eyaluator who through work with program constituents may have the greatest ' 
credibility m presenting or describing the evaluation to various audiences Without an 
admlS^ratorVde^^ spokesperson, the evaluation may simply die On the program 



_ Evaluation findings are not Utilized in many instances because of the organization's 
resistance to change. This resistance is evident when the reviewers of reports sfmplT 
receive the findings in a one-way transmission. However, stakeholder involvement in the 

commitment to prograin 

improvement predisposes program constituents to change. 

Timeljness of evaluation information is especially important to serve a decisioii- 
making purpose. If tne evaluation does not produce credible information at appropriate 
points in time, decisions are delayed or made without this input as a gUide. Again the 
utility of evaluation findings is reduced. '^gain, ine 

_ Frequently, evaluation results are viewed With the sole purpose Of directins decision 
making. This narrow view limits the potential utility of evaluation findinS foi other 
purposes-Hto create support for the program, to increase people's aWarenS abou° the 
program's benefits, and to help shape policy. 

_ ^ Finally, the nature of t^^^ evaluation findings influences their potential Usefulness 

P"-°'note understanding by providing inform^ on'harmaV be 
used pjnterpret activities, problems. outcomes in light of audiences' beliefs 
knowledge, or values have the highest Utility potential. 

^ ^PrgRgnr gv^Ui^rlnns ^hn^ld be conducted and r^nnrt^^ to ensure th^f^ K^^ii^.. 
inrormational needs of ^nBr ified auHiftfe-^P^^^ ^f^f ^ ^"^ nivr.r je 

fh.r, ^^^^^^^^^y vocational education programs need to become something ether 

°" improvements that cS be brought 

about by credible and valid information. Because of the various program stakeholder ^ 
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EVAtUAtlDN UTiUZAtiON 



Sroups. it.is important. to consider the various audiences throughout the evaluation and, at 
the same time, to consider alternative purposes for conducting the evaluations. 

_ Evaiuatioii reports can be used to demonstrate program accountability, to promote 
understandmg, and so oh. These purposes can all be served if the evaluation is designed 
with the future utility of its results in mind. 

c . benefits of increasing evaluation utility for specified audiences include 

the following: 

0 Improved programs for special populations 

o Stronger advocacy arguments 

o Improved evaluation research database 

o Increased UnderstanHinjj oi" the program 

o Support for special populations needs 

o Replicability inrormatibh for future evaluations 

o Acceptability of evaluation findings 

f The administrator who wants to justify smaller classes or more appropriate equipment 
for special populations needs credible data to support arguments before the school board 
The special populations parent advocacy group also needs this data for presentation to the 
state^legislature^or local school board. In the longer run, the research Community needs 
to improve its database about special populations programs. All of this will eventually 
increase understanding of the program and generate support. 
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9^ CONTlNUdUS EVAtUATION 



«r«. r°'""^"'-°. "^^"^^^ to formulate better secondary vocational education 

programs for specaLpopulations is a long-term process. As evaluation becomes a mdre 

k^il'^ h '-''T''' °' '^"'^^^'^^ endeavors, its findings expand ^e 
kr^wledge base, ^ecause pro^ on tbis knowledge, regular 

contribution^ to the knowledge base are required. Unfortunately, program evaluation" that 
are conducted sporadically-annually or less Often-contribute little. ^luations that 

'° "^'^"^ ^"^"^^ the systematic Identification of 

IS an effective problem-solving approach. Clarifying a problem, collecting information 
synthesizing information, acting on information, and providing feedback a're its e^S 

SH P''°'''em_^^delineation component of evaluation emphasizes the importance of oroblem 

Identification as^the first step in evaluation Of secondary vocational educadon S^^^ 
for special populations. The, evaluation is then focused, data are collected and mlan^ 
ingful information is generated and interpreted. Corrective actions ma^be specSffd for 

k-tl ^r°'' "^y ^^o lead to the identification of Lw pi^oblLs 

making the evaluation a continuous, cyclical process. prooiems, 

r,rnr^!V°'T^ °^^'^'^^'°''^'^^^'^ ^ dynamic and evolving 

oroblifSt SSf ^ '^'•"^^^^ '''' ' -"^^"^ ^^" ^^"^ Identifict ion .nd 

Continuous evaluation of vocational education ensures regular contributions to our 
understanding of its goals and benefits. This knowledge provides gene^a diSon f^ the 
field and ensures its contemporary focus. scuciai uiretiion lor tne 

C.I evaluation encourages ongoing examination of important problems and 

SlnX? ''"'f°T '' ^^^^"^^^^s the generation of alernative str^S Lr 

S^itc f., producing the desired result. Continuous evaluation also 

Sngs the— °' ^'"^^^'"^ '^^"^^ ^fi-ges o? the e:Slia1on 

progrilShoi^'Thi^'S'^'^^^ '""^ continuous flow of information to 

p~ofctdlt;. e^Sluatior^'"" ^"""'^'^ ^"^^^"^ '^'^^"^^ improvement: th. 




CONTINUOUS EVAtUAtiON 



, ^ The^ repdmriiendation set forth in this section has several potential beneflti 
including the fdllbwihg: 

0 Greater likelihood of incremental program imprbveriierits 

0 Immediate and continuous planning and improvement 

0 Greater knowledge about effective processes and practices 

Under the recomnrendation for process evaluation, the case was made for shorter prSiram 
improvemem cycles- that is, making corrections during the course of the program Not all 
problems can be dealt with on the short run, but require longer term solutions. Therefore 
It is^ essential that evaluation be continuous so that the larger problems may be dealt 
with incrementally, also. For example, it has been found that teachers hold the least 
favorable attitudes toward teaching educable retarded students. Deep-seated attitudes 
about the category of handicaps require incremental measures, the results of which need to 
be assessed repeatedly. The attitudes of program personnel are essential to program 

S''n^S«If.''H""""?^' ''''iu'"°" P^^^^^^ knowledge about the effectiveness 

of processes and practices. The pre assessment process used in developing individualized 
education plans (lEP) is a case in point. The assessment of results of lEPs can be the 
basis for curriculum modification; in other words, the lEP can be a vehicle for program 
evaluation as well as an individual planning tool. 
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10^ MANAGING THE EVALUAtidKi 



_ Maragirg an evaiuatibn intalls oSheslratin| the cohducl of all eValnition fim^ti„„s ■ 
differ?„ll°Uhi=h'S''fr'''''"" education agencies are no. clearly 

nation requirements that are associated with several levels Of bUreJLcr^y 

histoi^m^sr^jcS^^^^s^ ^'^^ 

stakeholders and will identify key S^e o "informatraforwhrcr '^T'"''" 
potential for acceptance of tL evaluation findings 

n..nS^W^ TI^^V™?'^ an, prog., information needs, 1^^ 
met and the data collection me ho^that lo^d 6e dLS^^^^ 

^^"^-^ - "^-Sr^jsr^ais^^^'^s^ 
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MANAGING THE EVALUATION 



Potentiai benefits of this recommendation include the foHowing: 

0 Increased sense of ownershijj in the evaluation 

0 Cost-effectiveness 

0 More responsive evailiations 

0 Incremental approach to program improvement 

State administrators prefer to administer evaluations from the state level but 

complain of insufficient funds to do so. An external evaluation can be very threatening 
especially if it is administered by a higher level agency that may also control funds 
When administered at the local level with the input from stakeholders, there is a Sense of 
ownership that increases Credibility which increases the chance of utilization. Because 
time and distance are less factors, and because some costs can be absorbed locally the 
locaUy administered evaluation is less costly. For most local personnel, the results will 
be more responsive to their needs. Further, improvements are more likely to be implemented 
merenientally simply because the evaluation is more likely to be a continuous process For 
example;^ the personnel m a handicapped program are far more apt to cooperate in a 
continuous process of evaluation if it is locally administered and it has the input 
attention, and cooperation of the parents of the handicapped students in the program The 
loca personnel would be more cooperative in providing data and more responsive to the 
results, all at a savings in cost. 
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APPENDIX A 



CHARACTERISTICS OF EFFECtlVE SECONDARY VOCATIONAL 
EDUCATION PROGRAMS FOR SPECIAL POPULATIONS 



^A major goai of this study was to Identify the characteristics of effective secondary 
vocational education programs for special populations (handicapped. disadvai^^eS ^fs fed 
Enghsh^proficient, smgle parent, and individuals enrolled in programs to elimfna'e'sex^ 
bias and sex stereotyping) Data for the study came from a review of the lite ature 
on-site visits to local schools, and a mail questionnaire to state coordinators of 
secondary vocat.iona education programs for special populations. Based on the analysis of 
the data, the following were identified as characteristics of effective programs 

o Community Setting 

- School personnel should encourage parental involvement in the program. 

- School personnel should actively and systematically provide parents with 
s?udentf °" Programs and services available to the parents and the 

- Public awareness programs should be included in school activities. 

- School personnel should be involved in educating emjDloyers in order to dispel 
common misconcejDtions about employing special populations workers. 

" iplyeS'"""'^ '""""''^ developing contacts with 

" iflit'S.^"'^ community members hold positions on school advisory 



0 Classroom Setting atirf Reillttfts 



■ J!^rWi^'' " ''''"^ ^^^-'-^^ons students should range 

- Positive social imeractions between special populations students and non soecial 
populations students should be encouraged. special 
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- All students should have e'zsy access to and iribvemeht through the classroom. 

- Assessment of equipment needs should be made on ah individual basii: 

- Special equipment that cannot be purchased should be custom built on the 
premises. 

" '"«"}''«^sho^l^ the responsibility of obtaining and 

providing information to special populations students on the types of special 
equipment available. F-^wiai 

- Sch^ool personnel should put f5rth an extra effort to accommodate the 
architectural and equipment needs of the students. 

o Personnel Cha ract e risti( ;T5! 

- Staff shouW be_ willing to experiment and should be innovative in the search for 
the most effective method for teaching each special populations student 

- Teachers should be positive role models and should attempt to alleviate social 
rejection by the student's classmates. 'cvidie social 

- School personnel should be non biased toward special populations students. 

■ Sooi P^f«^"el should enjoy working with special populations students and 
should be willing and able to work with students oh an individual basis. 

- School personnel should show patience when working with students. 

" popuiSonSJ;sr ""'^'^"^^ "^'^ ^''"^^ ^° ^^^^ 

- Administrators should have positive attitudes toward accommodating special needs 
populations students and are supportive of teachers. '"oaa^ng special needs 

- School personnel should have expertise In their subject field and additional 
training to work with special populations students. additional 

Financial 

" Sficf^ use.'"' °^ ^"""^^ coordinated to maximize their effective and 

- Funds should be available to maintain up-to-date equipment and materials. 
Pf&Assessmpnj 

^ ^^'^^l'?'^ °^J^^nm Styles, physical aHd/6? behavior problems and 
vocational interests and abilities should begin as early in the studTnfs 
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tS^^^^ ^"''^ possible, particuiafiy before the student enters high 
school or a vocational program; <=i"cic mgn 

- Pre assessment should be included as a part of career education bi ^ts^t 
exploration programs. 

■ Vocational evaluat^rs should conduct the diagnosis and should prepare the 
recommendations for all interested parties. 

• A yariety of assessment tools and methods should be used during the preassessment 
prxjcess including background data (student's family backgroundf medSaUnf^ 
mation.and educational performance); personal interview (obtain mforma k,^ on 
the students interests, attitudes, and behaviors); formalized testing ?documemed 
^S-f " vocational aptitude, and abilities); hands-on 

asspssment (student experiences thejype of work involved in the vocational 
program); and exit interview (information is distributed to all interested 

P3rtl6S^. 



Individoai Education^Plft n 

" handicapped student should be involved in the 

development of the individualized education plans (e.g., parents vocational 
counselors, special education teachers, vocational teachers). ^"^^^^lonal 

- The staff of the vocational educatioS department should be included in the 
preparation of the vocational component of the individualized education nlan 
particularly the instructors who will be working with the handiSpfS student. 

- eoordination should Occur between special education and the vocational education 
instrucjors m implementing the objectives stated in the individuauS educatfon 
plan and in evaluating the extent to which the goals are achieved 



Modifvini^ Curriculiiiti 

- Modi 
throu 
plans 



Modifications should be made based on the students' individual needs identified 
through the vocational assessment process and the individualized^ucat^n 

n^l'lP""*' instructors, special education teachers special 

cuSiJS! ^°°'-'"^^^°"' -d-inistrators should ^vork together to modlf" the 



' SrnlP'°f ' -'^^ ''''^'^ ^he instructional content, the 

sKSs^dr''"''' i-tructional materials to coordina^ with 

In^ructionai content should be adjusted to focus on subject areas that include 
self-esteem, basic skills, work attitudes and behaviors, job seeking sk 1 s^ 
independent living skills, and prevocational and vocat onal skili ' 
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" Teachers should use a variety of aiteriiativis methods and strategies for 
iiistructibn based on the levels and learriihg styies of students (e;g.; indi- 
vidualized ins^^^ jQl5 simulation, on-the-job 
training; computer-aided instruction, audiovisual aids, and group instruction). 

- Instructionai materials should be developed by special education, vocational 
personnel, and other school personnel to address individual needs. 

- Materials used for special populations should include hands-on activities for 
students. 



Support Services 

- Support services should be provided for speciai populations students and 
vocational instructors. 

- A full-time coordinator shojild be assigned to ensure that the appropriate 
services are identified and monitored. 

- A combination of educational agencies and community-based organizations 
should be involved in providing services to special populations {i.e., health, 
social service; welfare, rehabilitation agencies, and vocational education; 
special education, and regular education organizations). 



Ah effective and supportive administration should ensure the implementation of 
services for the vocational instructor and for the special population student. 



- Jnservice activities should be provided that address appropriate topics and 
involve qualified special populations professionals on a consultative basis. 

- Vocational instructors should have teacher aides or volunteers available for 
assistance with instruction in or out of the classroom. 

- Vocational support staff should be available to assist vocational instructors 
with any problems. 



- Teachers, students, administrators, parents, and others who are involved in the 
program should also be involved in the evaluation of the program. 

- A variety of input, process, and outcome variables should be considered du-ing 
the evaluation. 

- EvaJuatioh reports should be used for program planning, improvement 
accountability, and legal compliance. 
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o Stttdent T-v{jl|i|jt;nn 



- Student evajuation should involve mbhitoring the students' skill development and 
personal growth m attitudes and behaviors. 

• Information obtained through the evaluation process should be used to inform 
students, parents, and administration of student progress and what is necessary 
to improve performance. <=«aiy 

Traditional techniques of student evaluation (e.g., written tests) should be 
altered (e.g., teachers or aides read test, or test items written at lower 
reading levels) to assess special populations students accurately and according 
to their unique characteristics. 

Techniques Spt often used for evaluating special populations students should 
include^ formal testing (paper-and^pencil tests), performance testing, work 
simulation, and observations. 



o StB^nt Characteristics 

.u^!^^^ "^^ part of the search for characteristics of effective programs analysis 
of the data revealed the following general characteristics of special populations tudents 
m secondary vocational education programs: siuaents 

- Immature behavior 

- Short attention span 

- Easily frustrated and bored 

- Negative self-image and lack of self-confidence 

- Lack of communication skills 

- Performance below grade level 

- Poor health characteristics 

- Family income generally at or beiow poverty level 

netw^k of^!n^^!S' '''■^ for special populations involves a 

network of interrelated people, processes^ and structures. The characteristics of effec- 
tiveness Identified in this study function independently, yet contributras a whole i^ 
providing quality vocational education programs for specfal popu ation Thetlirac^eris 
tics, however, vary across schools and programs and are likely io vary over time 
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